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We claim: 

1. A method for inserting a caller's speech annotations into an original message, 
comprising the steps of: 

providing a speech rendering of said original message; 

annotating said speech message with at least one speech annotation; 

and 

inserting said speech annotation into said original message. 

2. The method of claim 1 wherein said original message is a text email message. 

3. The method of claim 1 wherein said original message contains at least one 
attached document. 



4. The method of claim 1 wherein said original message is a voice message. 

15 

5. The method according to claim 2 wherein said step of providing a speech 
rendering of said original message comprises converting said text message to 
speech. 

2 0 6. The method according to claim 3 wherein said step of providing a speech 
rendering of said original message comprises converting said attachment to 
speech. 

7. The method according to claim 1 further comprising the step of connecting to 
2 5 the mailbox of said email message by establishing a voice connection using a 

landline telephone or a mobile telephone. 

8. The method of claim 1 wherein said annotating step includes recognition of 
predefined commands for starting and stopping said speech annotation. 
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9. The method of claim 8 wherein said commands are speech commands. 
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The method of claim 8 wherein said commands are entered via Dual Tone 
Multi-Frequency (DTMF) tones. 

The method of claim 8 further comprising the step of using an interactive 
voice response (IVR). 

The method according to claim 8 wherein said speech commands are user 
defined. 

The method of claim 1 further comprising the step of recognizing said speech 
annotations of said caller. 

The method according to claim 1 further comprising the step of converting 
said speech annotations to text. 

The method of claim 14 wherein said step of converting annotated voice 
command to text is accomplished using Automatic Speech Recognition (ASR) 
and Speech-to-Text conversion. 

The method of claim 1 wherein said speech annotation is inserted in said 
original message in text format. 

The method of claim 1 wherein said speech annotation is inserted in said 
original message as a sound file. 

The method of claim 1 further comprising the step of storing said annotated 
message at the Unified Messaging server after inserting said speech annotation 
into said message. 

The method according to claim 18 wherein said step of storing said annotated 
message includes creating a new copy of said message. 
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The method according to claim 1 further comprising the step of forwarding 
said annotated message to another- user. 

An apparatus for inserting a caller's speech annotations into an original 
message, comprising: 

means for providing speech rendering of said original message; 

means for annotating said speech message with at least one speech 

annotation; and 

means for inserting said speech annotation into said original message. 

The apparatus of claim 21 wherein said original message is a text email 
message. 

The apparatus of claim 21 wherein said original message contains at least one 
attached document. 

The apparatus of claim 21 wherein said original message is a voice message. 

The apparatus according to claim 22 wherein said means of providing a speech 
rendering of said original message comprises means for converting said text 
message to speech. 

The apparatus according to claim 23 wherein said means of providing a speech 
rendering of said original message comprises means for converting said 
attachment to speech. 

The apparatus according to claim 21 further comprising means for connecting 
to the mailbox of said email message by establishing a voice connection using 
a landline telephone or a mobile telephone. 

The apparatus of claim 21 wherein said annotating means includes means for 
recognition of commands for starting and stopping said speech annotation. 



29. 
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The apparatus of claim 28 wherein said commands are speech commands. 



30. The apparatus of claim 28 wherein said commands are entered via Dual Tone 
Multi-Frequency (DTMF) tones. 
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31. The apparatus of claim 28 further incorporating the interactive voice response 
(IVR). 

32. The apparatus according to claim 28 wherein said speech commands are user 
10 defined. 

33. The apparatus of claim 21 further comprising means for recognizing said 
speech annotations of said caller. 

15 34. The apparatus according to claim 21 further comprising means for converting 
said speech annotations to text. 

35. The apparatus of claim 34 wherein said means of converting annotated voice 
command to text is accomplished using Automatic Speech Recognition (ASR) 

2 0 and Speech-to-Text conversion. 

36. The apparatus of claim 21 wherein said speech annotation is inserted in said 
original message in text format. 

2 5 37. The apparatus of claim 21 wherein said speech annotation is inserted in said 

original message as a sound file. 

38. The apparatus of claim 21 further comprising means for storing said annotated 
message at the Unified Messaging server after inserting said speech annotation 

3 0 into said message. 
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The apparatus according to claim 38 wherein said means of storing said 
annotated message includes creating a new copy of said message. 
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40. The apparatus according to claim 21 further comprising the means for 
forwarding said annotated message to another user. 



